DOCUMENT RESUME 



ED 259 683 



HE 018 611 



AUTHOR 
TITLE 

PUB DATE 
NOTE' 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Christ 

Planning in a Dutch University. 



Savenije, Bas; Otten, 
Qualitative Issues of 
AIR 1985 Annual Forum Paper. 
May 85 

22p.; Paper presented at the Annual Forum of the 
Association for Institutional Research (25th, 
Portland, OR, April 28-May 1,, 1985). 
Reports - Evaluative/Feasibility (142) — 
Speeches/Conference Papers (150) 

MF01/PC01 Plus Postage. 

*Change Strategies; *College Planning; *Col ( lege 
Programs; Educational Change; Foreign Countries; 
Higher Education; Organizational Change; *Program 
Evaluation; *Research, Projects ; Resource Allocation; 
Retrenchment 

*AIRi Forum; *State University of Utrecht 
(Netherlands) 



\ 



ABSTRACT 

Results of changes to the planning process at the 
University of Utrecht in the Netherlands are described. During the 
past years, government actions related to retrenchment prompted the 
Dutch universities to change their planning process in order to 
increase flexibility and to account for differences in quality. Two 
important' procedures were carried out: restructuring of educational 
programs and an external review of research programs. The new 
structure of educational programs included a four-year degree 
program, selective admission to graduate programs, and a limitation 
on the period that students can attend college. Educational 
restructuring resulted in greater emphasis on general studies and a 
postponement of specialization; a modular organization of programs; 
mor* attention to measuring output (e.g., graduation rate) as well as 
qualitative issues; and changes in the resource allocation model. 
Results of the external review of research programs included: most of 
the departments were able to submit more research programs than was 
calculated; differences among departments were due to historical 
factors, such as the value attached to research activities and 
fluctuation in student enrollment; and research activities were 
grouped into broader programs. (SW) 
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Abstract 

During the past years government measures related to retrench- 
ment have urged the Dutch universities to change their plan- 
ning, process in order to increase flexibility and \£o account 
for differences in quality* Two important procedures carried 
out in this context are now in a final stage: an external re- 
view of research programs and the restructuring of educational 
programs. The results of these operations are analysed, with 
emphasis on their impact for program quality. The paper also 
discusses th* consequences of these results for the planning 
process. 
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1 . Introduction 

Since 1980 Dutch universities have been overwhelmed by a 
number of government measures related to retrenchment: 

1. The universities were forced to restructure their curricula 
from the existing five to six years into a four-year 
curriculum; an important objective of this change was to 
increase the program output. 

2. Staff /student radios in the budgeting model of the Ministry 

) . 

of Education were seriously reduced , for some disc ip lines 



as much as 40%, which of course meant a normative recfcction 
of the teaching load. 

3. In a nation-wide process specific fields of study were 

* j ' 

concentrated in one or two universities. This Concerned not 

only highly specialized curricula with very small 

enrollment, such as exotic languages, but also a number of 

larger ones; the University of Utrecht, for instance, had 

to give up dentistry, a program with about 600 students 

(1). 

The Ministry of Education developed new budgeting 

procedures in o/der to allocate research funds to 

universities on the basis of the volume of submitted 

k 

research programs of acclaimed and externally reviewed 

quality in five-year cycles. 
These measures have forced the Dutch universities to 
restructure their planning process in order to take 
qualitative aspects into account and to increase flexibility 
(2), ^number of procedures developed in this context are now 
in their final stages which alljfew a first evaluation. 
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This concerns in particular the new budgeting procedures for 
research programs on the basis of external reviews and the 
restructuring of educational programs (3), ^ 
The purpose of this paper is to investigate the way in which 
these two processes have already resulted' 'or will result in 
qualitative changes in research and educational programs and 
to which extent these changes can be taken into account for 
the allocation of funds. 

The new budgeting procedures for research pr.ograms 

* / • • 

In the seventies the Dutch Ministry of. Education used to 

divide the budget for higher education among _ the universities 

on the basis of the number of students'. The- internal 

allocation models of the universities too were enrollment 

driven: funds for educational programs as well as for research 

programs were allocated.- on the basis of the numbtr of 

students. This structure of the allocation models was linked 

to the view that teaching and research were symbiotip 

counterparts, woven together into one strong fabric. For a 

long time it had heen^ considered necessary for each faculty 

member to do research as well as teaching, j 

In 1980 demands for accountability (4) led the Ministry of 

Education to the development of new budgeting procedures, x 

Among other things tlvse new procedures introduced the 

allocation of a large part of the research funds to the 

universities on the basis of the quality of research programs, 

independently of the number of students. The Ministry 

calculated the research capacity of each university by 



subtracting v the teaching load and the faculty needed for 
'approved public services from the total number of faculty of a 
university. Financing of this, research volume would only be 
continued when the university was capable of submitting an 
equal volume of externally reviewed research programs of 
acclaimed quality. The budget for these programs would be 
guaranteed for 5 years, while the process should noc lead to 
budget cuts at least until the end of 1984. The Ministry and 
the universities agreed upon the . appointment of external 
review boards, most of which were existing committees with 
approved expertise in a specific field of research and, 4 in 
some cases, the social aspects thereof. Conditions were set 
concerning the minimum size of the programs (5 fte), although 
protest against this condition finally led to a more flexible 
attitude . 

In order to meet these requirements the University of Utrecht 
started a new budgeting procedure in 1981. This procedure con- 
tained three rounds. In the first round 'the University Board 
asked every department to account for high quality research 
programs to a maximum of one t'hird of its calculated research 
capacity: these programs would be safeguarded against cutbacks 
within the university. The condition concerning the minimum 
size of programs forced the departments to look outside usual 
borders to make links with other research programs. 
There were a nymber of reasons for the University Board to 
stipulate a maximum for this first round . Not only did this 
seem necessary in order to guarantee a careful start of this 
fairly new procedure and to prevent rash decisions; it also 

7 
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stimulated discussions about priorities withify the 

* 

departments. The first round ended in 1982. It was agreed that 
the results would not immediately lead to a reallocation of 
funds. 

The next year, in the second round, the departments had Lo 
submit programs of high quality for at least half of their 
calculated research capacity. Thus the discussion about 
priorities changed into a call for justification of the 
research capacity. 

On the basis of the results of the first and second rouncl, of 
the research capacity calculated , and of the actual research 
capacity according to the annual reports of the departments, a 
target was fixed for *each department for the third < and final 
round. In 1983 the indicated budgets for the next years were 
based on thise targets. The third round would only lead to 
changes in these budgets, if a department were to fail its 
target. 

The third round was completed in 1984. 

The quantitative results of the three rounds are summarized in 
table I and II. 

Table I shows for each department and for each of the tfyree 
Subsequent rounds the volume of research programs submitted 
for review and the volume of programs receiving favorable 
reviews, both expressed in full-time equivalents and the 
number of programs. Not included are Computer Sciences 
(started in 1983) and some small institutes. 

J'able II shows a comparison between the calculVjfed research 
capacity for 1982, the actual research capacity according to 
the annual reports of 1981 and the results of the external 
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Tabel I: Submitted and accepted programs in fte and number of programs 



Department 


after 

first round 


> 

i 

after second round 


>. 

after third round 


submitted 


submit ted 


accepted 


i 

submitted accepted 


fte progr 


fte progr 


fte progr 


fte*progr fte progrl 


Theology 

i 
i 

J Law 
i 

■ Arts 

'Philosophy 

i 

* 

Mathematics 

,Phy s ic s / as t ronomy. 

Chemistry 

Earth sciences 
• Biology 

Pharmacy 

geography 
S^ial sciences 

Medicine 
. Dentistry 
Veterinary sc. 


3 4 
10 15 
19 '17 

3 4 

19 11 
26 11 

20 14 
16 10 

5 4 

4 4 
26 19 

62 28 
3 1 
14 11 

/ 


6 5 
36 12 
47 14 

9 7 

35 7 
52 11 
57 9 

36 4 
77 13 

1 19 2 

! 

22 5 
68 20 

90 «- 19 
18 3 
68 13 


6 5 
20 7 
46 13 

7 5 

35 7 

52 11 
26 6 

36 4 
60 8 

16 1 

17 4 

53 17 

76 14 
6 1 
55 11 

i 


16 ' 7 
48 13 
89 18 

9 5 i 
35 7 

72 12 ; 

1 

79 13 , 

41 4 1 

l 

82 15 : 
22 3 

27 6 
110 30 

117 .35 
22 6 
82 16 


i 
1 

15 6 | 

1 

47 13 ! 
86 18 
9 5 

35 7 
72 12 
69 12 
41 ' 

82 15 : 

1 

22 2 ! 

26 6 
100 30 

102 27 
12 3 
79 16 


Total 


230 153 

t 


640 143 

1 0 


! 511 114 


851 190 

I 


797 176 
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Tabel II: Research capacity and accepted programs. 









act . 






al LCI 


3rd round 

* — — - 




calculated 


res . 




after 




% of 


/V or 


.1 


research 




cap. 




zna 




calc . 


act. 


Department < 


capacity 


1982 


1981 


target 


round 


fte 


res. 


res , 


f te 


%* 


fte 


fte 


fte 


cap , 


cap. 


Theology 


15 


44% 


12 


14 


6 


15 . 


1 A A <7 


1 icy 


Law 


40 


28% 


53 


40 


20 


47 


1 1 QfT 

1 1 OA 


fl Q7 


Arts ! 


79 


27% 


108 


79 


46 


86 




OU/o 1 


Philosophy 


7 


33% 


10 


7 


■» 

/ 


9 




G07 

i 


Mathematics 


30 


54% 


29 


29 


35 


35 


117% 


1 

121% 


Physics /astronomy 


62 


57% 


0 / 


U L 


52 


72 


116% ' 


107% 


Chemistry 


95 


73% 


73 


73 


26 


69 


7 '\7 


9*3% i 

1 

i 


Earth sciences 


54 


63% 


41 


41 


36 


41 


76% 


100% 1 


Biology 


89 


53% 


7 7 


77 


fin 


82 


92% 


106% 


Pharmacy 


16 


33% 


28 


16 


16 

i 


22 

! 

i 


1 JO/q 

if 


/ y /o 


| Geography 


9 7 




23 


i 
i 

23 


I 

1 17 

1 


, 26 


96% 


113% 


i 

1 9nr"fal sciences 


124 


39% 


109 


109 


1 

: 53 

i 

i 


100 


81% 


92% 


Mpn "I c i ne 


110 


23% 


161 


110 


i 

1 


1 

102 


93% 


63% 


Dentistry 


41 


33% 


2.5 


25 


l 

! 6 

j 


i 12 


29% 


48% 


Veterinary sc. 


37 


13% 


71 


37 


! 55 

1 


1 79 

i 


214% 


111% 


Total 


826 • 


38% 


887 


742 

• 


511 


1 851 

1 

i 


103% 


96% 



percentage of the total number of faculty in fte. 
act. res. cap. = actual research capacity . 
calc. res. cap. - calculated research capacity £ (j 
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3* Consequences of the new budgeting procedures for research 
programs 

The procedures described above and the results as shown, in the 
tables enable us to draw the following conclusions. 
a * Submitted programs vs« calculated research capacity 

The data in table II show that most: of the departments were 
able to submit more research programs than the research 
capacity calculated. For the university as a whole this 
resulted in a larger number of programs than was needed 
from the point of budget-defense. An explanation for this 
can be found in the fact that the calculation of the 
teaching load also accounts for time spent with research 
activities closely connected to contributions to the 
educational programs. Clearly parts of these research 
activities are contained within high quality research 
programs. 

Differences among departments with regard to the results 
are not related to disciplines. Table II also shows that 
there is no relation between research capacity (calculated 
or factual) and the success in submitting high quality 
research programs. The degree of success , hoW^fer , bears a 
relation to the degree of divergence between the research 
capacity calculated and the actual one. This means that the 
differences among departments are due to historical 
factors, such as the value attached to research activities, 
recent fluctuations in student enrollment and the affinity 
of faculty for educational tasks. 




Organisational consequences 



The process has stimulated a gro ping of indl vidua 1 



research activities jttito broader programs. 

The average size of a program can be seen in table I: 

\ 

^ubmitted in the first round : 230/153 » 1.50 fte; * 
accepted after the second round: 511/114 » 4.48 fte; 



accepted after t^e third round : 797/ 176 * 4.53 fte. 

This shows that while more fte of research programs were 

submitted, the average size of the programs became larger. 

Of course this expansion of successful programs is only 

I 

partly caused b^new research activities started in close 
connection with these programs. There has also been a 
grouping of ^individual activities under a common 
denominator. Fr6m a viewpoint of quality enhancement this 
process has to be welcomed, because the planning and 
evaluation (necessarily because of the limitation of the 
budget guarantee) can now take place in a broader context. 

i 

As a consequence we have observed that departments tend to 
change their organisational structure in order to streng- 
then the management of research programs- This will proba- 
bly lead to the start of a number of research institutes, 
within as well as across departments. 
Consequences for the planning process 

The usefulness of the results of the process described as 
an input for the allocation mod^ is limited. 
We have seen that the sum of submit ted programs for the 
university was more than was needed f rom the viewpo int of 
budget-defense . In other words the total sum of the 
programs exceeded the research capacity calculated and 
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consequently additional funds are required to finance these 
programs when they cannot be financed at the cost of other 
activities. But the same situation occurs at most of the 
other universities and the additional funds needed are not 
at :he Ministry's disposal. Therefore it appears to be 
necessary for the universities and the departments to state 
priorities in order to translate the results int^^input 
data for the present allocation model. Up. to this moment 
the submission of extra programs has not ■ J.€(l to financial 
consequences 

An important disadvantage of the process was its 
time-consuming character. To make the external review 
possible for each program in each round a certain amount of 
information has to be submitted on forms. But not only 
these forms had. to be fillti out (an<J checked by the 
administration of departments, university and Ministry), 
they also had to be judged by the departmental councils and 
reviewed by the committees. 

The total sum of all programs of all the universities in 
thtstfe' three rounds amounted more than 4000 fte. The general 
feeling is that while the introduction of this procedure 
has certainly had positive effects, it can not serve as a 
blueprint for a continuous process* But, more importantly, 
on** is becoming aware that a thorough evaluation will be 
necessary in order to check that the programs submitted are 
actually carried out in a satisfactory manner. 
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4. The restructuring of educational programs. 

After twelve years of discussion and university opposition a 
law establishing new curricula types was passed in Parliament 

i 

in 1980. This law forced the universities to restructure their 
curricula from the existing five "r six years into a four year 
curriculum, ( 

The purposes Oi this restructuring process can be summarized 
as follows : 

✓ 

1. to satisfy the changing needs of individuals as well as of 
society for university education; 

2. to maintain or enhance the quality and efficiency of 
educational programs, including an increase of output; 

3. to increase the flexibility of educational programs; 

4. to bridge the gap between universities and other institutes 
of higher education,* 

Important features of the new structure of educational 
programs are: 

1. a four year curriculum leading to an academic degree; 

2. selective admission to graduate programs (5); 

3. a limitation of the period during which students can be 
registered at universities. 



The four year curriculum is divided into two parts* The 
intention of the first year ("propaedeutics") is to make the 
students familiar with the field of study in order to enable 
them to judge whether this field of study corresponds with 
their expectations and also to bring about a selection among 
the students. Every student which completes the first year 
with success, is supposed to be able to finish the entire 
I^-Mes curriculum su sefully. 14 



The program for the next three years ("doctoral phase 11 ) has to 
be constructed with flexibility and variety, with an eye 
towards the - features desired from graduates, individual 
Capacities and interests of students , changing needs of 
society and professional opportunities. For this purpose a so 
called "dossier diploma 11 was introduced. Such a diploma or 
certificate is the conclusion of an educational program in 

which a student has selected his own courses, according to his 

r 

personal needs, without being confined to one department. Such 
a program, however, has to be approved by a department in 
order to guarantee the quality of the program. 

It is expected that the restructured curricula will lead to 
increased output . Firstly, the length of the programs is 
reduced from five or six years to four years, which means a 
smaller chance for students to loose their motivation in the 
course of their study. Secondly, the programs are. better 
at tuned to the interests of students : the more freedom 
students get to select their own courses , the more students 
will graduate . Thirdly, a change of program does not 
necessarily prevent a student from taking along the credits 
for the courses he has already finished. 

In September 1982 the first courses of the restructured 
programs were started. 
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5. Consequences of the restructuring of educational programs . 

This chapter describes the most important consequences of the 
restructuring of educational programs at our university. 

a . Or g an! sat ional consequences . 

The possibility for students to construct programs on an 
individual basis has stimulated departments to change the 
way in which they organize their programs. Programs used to 
be organized rather rigidly in one direction from the 
beginning to the end, with very limited possibilities to 
take courses outside the department. 

In order to account for the increased flexibility programs 
new tend to evolve towards a more general set-up with 
postponement of the moment of specialization. In their 
first year student s receive a general introduction in a 
rather wide field of study (for instance Social Sciences). 
As they advance * the opportunity for specialization grows 
(for instance Art history of the Middle Ages, Social 
Psychology) . 

' Jn order to enable /students to choose their courses from 
any department a certain organisational conformity between 
the courses is necessary. Therefore a modular structure of 
fll the programs is aimed at, notwithstanding the 'bridges 
to be gapped between the different departments. 

b. More atte ntion for output measurement and qualitative 
aspects , 

One of the purposes of the restructuring process is, as we 
have seen, the increase of output of educational programs. 
In the Netherlands output is generally measured with the 
aid of graduafion rates (6). Together with enrollment 
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predictions, these graduation rates form the basis for the 
calculation of the teaching load* The Ministry of Education 
has employed this method for several years , but used 
graduation rates that not only were outdated, but also 
averaged for all universities* To stimulate the increase of 
output these data are replaced by graduation rates based on 
recent data and differentiated for each university (7), 
As a consequence the interest for output data has grown 
within the universities* For the present this interest 
concentrates on the results of the propaedeutical exams and 
their possible impact on graduation rates. The first 
results of the propedeut ical exams actually just if y the 
expectation that the average graduation rate of the 
programs before the restructuring process (55-60%) will 
increase to more than 65% for the new programs* 
But this interest for output almost automatically 
stimulates a discussion about other qualitative aspects, 
for every system that stimulates the production of output 
carries in itself a certain danger for the quality of the 
output* 'This is one of the reasons that students' and 
faculty in the University Counc il as well as several 
departmental councils show a growing interest in 
qualitative issues concerning educational programs. 
Therefore procedures are being developed for a. systematic 
evaluation of educational programs*- 
c» Consequences for the allocation model 

As we have seen the teaching load in most Dutch 
universities is calculated with the aid of graduation 
rates* There are a number of reasons why an allocation 




model based on graduation rates can not meet the 
requirements of the new structure (8). 

Firstly, to make graduation rates useful in a planning 
process it is necessary to make a prediction. But the 
calculation of a graduation rate can only be made after a 
number of years and the value of the prediction can be 
seriously questioned, when the circumstances change as fast 
as they have done in the past years. 

Secondly, modular structures bring forward the need for an 
allocation model, in which output is not traditionally 
measured in terms of number of graduates but on a more 
refined level. Since not every student will take all his 
courses within one department the allocation model has to 
account for the teaching load concerning students from 

; 

other departments. An allocation model can give a stimulus 

m 

for the production of more output when it is based on 
output measurement. But a calculation of the teaching load 
based on the number of graduates will not be an incentive 
for departments to make their courses attractive for others 
than their own students. 

An example of a more flexible system is a budgeting model 
under consideration in the University* of Utrecht based on 
the number of credit-points earned by students in the 
previous year with courses within each department. 
However , a certain reluctance to abandon the graduation 
rate as a basis for the allocation model can be observed . 
One of the 'reasons for this preference for the graduation 
rate probably is that one is inclined to think that a 
graduation rate gives an overall judgment of quality. 

'18 




In the -first place, however, it is questionable whether 
quality can be attributed to programs as a whole (let alone 
institutions as a whole) (9). But the danger of loss of 
quality is less too when the output is measured of smaller 
sets'" of courses or even of individual courses. The smaller 
the set of courses of which the output is cpnsidered , the 
sooner the data will be available, the easier it is to find 
other courses to compare with, and the easier it is to 
not ice the occurrence of undesired side-effects • In other 
words a model based on the output of single courses has 
certain dangers, but also produces the data one needs to 
signalize whether undesired effects actually occur. 

Summary and conclusion 

As a consequence of retrenchment the University of Utrecht had 
to change its planning process in order to take qualitative 
aspects into account* This paper has described the first 
results of two procedures resulting from these changes* 

The following conclusions can be drawn from an evalution of 
the external reviewing of research^ programs: 

a* a grouping of individual research activities has taken 
place, which can be expected to lead to a way of organizing 
and managing research activities that is more apt for the 
activities involved; 

b, the extent of high quality research programs of most of the 
departments v Larger than was needed from the viewpoint 
of budget defense; differences among departments with 

19 
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Fegards to the results wnre not related to disciplines, but 
to historical factors; 

c. the quantitative results of the reviewing process can not 
be translated directly into input data for che present 
allocation model; 

d. the time-consuming character of the procedure involved 
makes it impossible to use it year after year. 

The restructuring process of educational programs has the 
following consequences: 

a. programs tend to evolve to a more general set-up with 
postponement of the moment of specialization; 

b. it has become necessary to organize the programs in a 
modular structure; 

c. the special attention given to the expected increase of 
output stimulates discussions about qualitative aspects and 
the introduction of evaluation procedures; 

d. it is necessary to change the allocation model in order to 
take the consequences of the process into account. 

In general it can be concluded from the two procedures 
described that conditions have been created f ot quality 
enhancement of research and educational programs by 
introducing possibilities to respond to changing needs of 
society* However , after th4. rather time-consuming sturt^ good 
and effective procedures for the evaluation off the programs 
are to be developed in order to observe the actyal results and 
to preserve the improvement that has act ially taken place. 
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Notes. 

(1) For a description of this process, see Rosenberg (1983). 

(2) A 4 description of the problems caused by the government 
measures and the development of new planning procedures by 
the University of Utrecht can be found in Dijkman & Savenije 
(1983) • The consequences for a department within this 
university are described in Verweel ( 1984) • 

(3) The term "educational program" in this paper is used in the 
sense of a series of courses leading to a degree or 
certification. 

(4) A survey of different factors forcing higher education to be 
accountable for faculty members performance and to regulate 
more exactly the assigment of workload is given in Olswang & 
Lee (1984). 

(5) In the years that have p_assed since^ 1980 the discussion about 

the purpose and the structure of graduate programs has passed 

several stages; it now appears to be in cits final stage. 

x 

(6) A graduation rate is the percentage of a cohort of entering 
freshmen which receive a degree at some time. 

(7) The start of this measure was somewhat delayed because of the 
difficulties in giving proper definitions for the concepts 
involved. 

(8) A study of the relation between the stimulation and 
iniprovement of output and quality enhancement for ' Dutch 
universities can be found in Savenije (1984), 

(9) See also: Fincher (1984), p. 9. 
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